Control apparatus, control method, and computer-readable recording medium

ABSTRACT

A control apparatus for controlling an image capture apparatus includes a communication unit and a control unit. The communication unit transmits a first command to the image capture apparatus if a predetermined area in a captured image received from the image capture apparatus and a pointer operated by an operation unit are overlapped. The communication unit transmits a second command to the image capture apparatus if a button of the operation unit is clicked in a state that the predetermined area and the pointer are overlapped.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a control apparatus for controlling animaging apparatus, a control method, and a computer-readable recordingmedium.

2. Description of the Related Art

Japanese Patent Application Laid-Open No. 2005-210589 discusses a remotecontrol system, in which a personal computer (PC) including a displayand pointing devices, such as a mouse, connects to a digital camera witha cable, and remotely controls the digital camera.

In such a remote control system, a digital camera captures an imageaccording to a shooting signal transmitted from a PC, and transmitscaptured image data to the PC. The PC receives the image data, anddisplays the image data on a display.

However, a user can only confirm the image data after performingshooting, on a display of a PC where the data are transmitted from thedigital camera, and cannot confirm the image data on the display beforethe user captures the image with the digital camera. Therefore, there isa disadvantage that unintended image data is captured and the usercannot acquire the desired image data.

SUMMARY OF THE INVENTION

The present invention is directed to overcome the above-describeddrawback and disadvantage.

The present invention is directed to a remote control system by which auser can acquire desired image data.

According to an aspect of the present invention, there is provided acontrol apparatus for controlling an image capture apparatus,comprising: a communication unit that receives a captured imagetransmitted from the image capture apparatus; and a control unit thatcontrols the control apparatus to display the captured image received bythe communication unit in an image display area, wherein the controlunit controls the control apparatus to display information indicating apredetermined area on the captured image displayed in the image displayarea, wherein the control unit determines whether or not thepredetermined area and a pointer operated by an operation unit areoverlapped, wherein the communication unit transmits a first command tothe image capture apparatus if the control unit determines that thepredetermined area and the pointer are overlapped, wherein the controlunit determines whether or not a button of the operation unit is clickedin a state that the predetermined area and the pointer are overlapped,wherein the communication unit transmits a second command to the imagecapture apparatus if the control unit determines that the button of theoperation unit is clicked in a state that the predetermined area and thepointer are overlapped, wherein the first command is a command forcausing the image capture apparatus to perform a shooting preparationprocess based on an image within the predetermined area, and wherein thesecond command is a command for causing the image capture apparatus toperform a shooting process for capturing a still image.

According to another aspect of the present invention, there is provideda method of controlling a control apparatus for controlling an imagecapture apparatus, the method comprising: receiving a captured imagetransmitted from the image capture apparatus; displaying the capturedimage transmitted from the image capture apparatus in an image displayarea; displaying information indicating a predetermined area on thecaptured image displayed in the image display area; determining whetheror not the predetermined area and a pointer operated by an operationunit are overlapped; transmitting a first command to the image captureapparatus if it is determined that the predetermined area and thepointer are overlapped; determining whether or not a button of theoperation unit is clicked in a state that the predetermined area and thepointer are overlapped; and transmitting a second command to the imagecapture apparatus if it is determined that the button of the operationunit is clicked in a state that the predetermined area and the pointerare overlapped, wherein the first command is a command for causing theimage capture apparatus to perform a shooting preparation process basedon an image within the predetermined area, and wherein the secondcommand is a command for causing the image capture apparatus to performa shooting process for capturing a still image.

According to another aspect of the present invention, there is provideda computer-readable recording medium storing a program executed by acomputer, wherein the program for using the computer to perform a methodof controlling a control apparatus for controlling an image captureapparatus, the method comprising: receiving a captured image transmittedfrom the image capture apparatus; displaying the captured imagetransmitted from the image capture apparatus in an image display area;displaying information indicating a predetermined area on the capturedimage displayed in the image display area; determining whether or notthe predetermined area and a pointer operated by an operation unit areoverlapped; transmitting a first command to the image capture apparatusif it is determined that the predetermined area and the pointer areoverlapped; determining whether or not a button of the operation unit isclicked in a state that the predetermined area and the pointer areoverlapped; and transmitting a second command to the image captureapparatus if it is determined that the button of the operation unit isclicked in a state that the predetermined area and the pointer areoverlapped, wherein the first command is a command for causing the imagecapture apparatus to perform a shooting preparation process based on animage within the predetermined area on which the pointer is overlapped,and wherein the second command is a command for causing the imagecapture apparatus to perform a shooting process for capturing a stillimage.

Further features and aspects of the present invention will becomeapparent from the following detailed description of exemplaryembodiments with reference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate exemplary embodiments, features,and aspects of the invention and, together with the description, serveto explain the principles of the invention.

FIG. 1 illustrates an example of a remote control system according tothe first and second exemplary embodiments of the present invention.

FIG. 2 is a block diagram illustrating a schematic configuration of aremote control system according to the first exemplary embodiment of thepresent invention.

FIGS. 3A and 3B illustrate an example of a camera control screendisplayed in a control apparatus according to the first exemplaryembodiment of the present invention.

FIG. 4 is a flowchart illustrating an example of process performed by animage capture apparatus according to the first exemplary embodiment ofthe present invention.

FIG. 5 is a flowchart illustrating an example of process performed by acontrol apparatus according to the first exemplary embodiment.

FIG. 6 is a block diagram illustrating an example of a schematicconfiguration of a remote control system according to the secondexemplary embodiment of the present invention.

FIGS. 7A and 7B illustrate an example of a camera control screendisplayed in a control apparatus according to the second exemplaryembodiment of the present invention.

FIG. 8 is a flowchart illustrating an example of process performed by acontrol apparatus according to the second exemplary embodiment of thepresent invention.

DESCRIPTION OF THE EMBODIMENTS

Various exemplary embodiments, features, and aspects of the inventionwill be described in detail below with reference to the drawings.

FIG. 1 illustrates an example of a remote control system according tothe first exemplary embodiment of the present invention. FIG. 2 is ablock diagram illustrating an example of a schematic configuration of aremote control system according to the first exemplary embodiment of thepresent invention. As illustrated in FIGS. 1 and 2, the remote controlsystem according to the first exemplary embodiment includes a controlapparatus 100, a connection cable 300, and an image capture apparatus200. The control apparatus 100 and the image capture apparatus 200 areconnected each other via a transmission path such as the connectioncable 300.

In the first exemplary embodiment, a personal computer (hereinafterreferred to as PC) is used as an example of the control apparatus 100,and a digital single lens reflex camera (hereinafter referred to as acamera) is used as an example of the image capture apparatus 200.Further, in the first exemplary embodiment, a universal serial bus (USB)cable according to a USB standard is used as an example of theconnection cable 300.

The first exemplary embodiment will be described in detail below.

The USB cable 300 includes a data line for bidirectionally transmittingdata, a strobe signal line for transferring a strobe signal, and a powersupply line.

In the data line, a protocol for controlling the camera 200 connectingto the PC 100 is provided. By using this protocol, a user can transfervarious data and control between apparatuses of the USB-compliant PC 100and the camera 200.

The strobe signal line is a line for transmitting a strobe signal. Thestrobe signal is a signal indicating that data are being output from anapparatus side that transmits the data to an apparatus side thatreceives the data. Further, the data transfer is performed at both arise time and a fall time of a strobe signal. An apparatus receiving thedata generates data which is transmitted through the data line and thestrobe signal line.

The power supply line supplies power from the PC 100 to the camera 200if necessary.

In addition, the connection cable 300 is not limited to the USB cable.Any connection cable other than the USB cable can be used if theconnection cable has a line for transmitting image data, sound data, andauxiliary data. Further, although the USB cable is used as theconnection cable 300 for enabling communication between the PC 100 andthe camera 200, the PC 100 and the camera 200 can also be connected bywireless communication.

The PC 100 uses the monitor to display image data such as still imagedata and moving image data (video) transmitted from the camera 200, andto output audio data transmitted from the camera 200 from a speaker viathe USB cable 300. Furthermore, the PC 100 generates a control commandfor controlling the camera 200 based on an input from a user, andtransmits the control command to the camera 200 via the USB cable 300.

As illustrated in FIG. 2, the PC 100 includes a central processing unit(CPU) 101, a memory 102, a communication unit 103, a display unit 104,and an operation unit 105.

The CPU 101 controls an operation of the PC 100 according to a controlprogram stored in the memory 102.

The memory 102 also functions as a main memory of the CPU 101, andstores data received by the camera 200 from the communication unit 103.Further, the memory 102 stores a plurality of icons for notifying astate of the PC 100 to a user, and a control program for controlling theoperation of the PC 100. Furthermore, the memory 102 stores informationof a menu screen to be displayed on the display unit 104.

The communication unit 103 has a terminal for connecting the USB cable300. The communication unit 103 can receive image data, sound data, andauxiliary data, which are transmitted from the camera 200 via the USBcable 300. The image data transmitted from the camera 200 is stored inthe memory 102, and then displayed in the display unit 104. The sounddata transmitted from the camera 200 is output from a speaker which isnot illustrated. The auxiliary data transmitted from the camera 200 issupplied to the CPU 101.

The display unit 104 is configured with a=monitor such as a liquidcrystal display. The display unit 104 can display image data suppliedfrom at least one of the memory 102 and the communication unit 103.

Further, the display unit 104 can display a menu screen stored in thememory 102. The menu screen includes a PC control screen for controllingthe PC 100, a PC setting screen for changing setting of the PC 100, or acamera control screen 400 for controlling the camera 200, which isillustrated in FIG. 3. The camera control screen 400 will be describedin detail below.

In addition, when the menu screen is displayed in the display unit 104,a mouse pointer (an icon having the shape of an arrow) 500 is displayedon the menu screen. The mouse pointer 500 performs inputting to a buttonand a scroll bar which are displayed on the menu screen, and moves onthe menu screen. Therefore, in order to know the position of the mousepointer 500 on the menu screen, the CPU 101 acquires coordinateinformation of the mouse pointer 500 which indicates a position of themouse pointer 500.

The CPU 101 performs control to display image data supplied from thecommunication unit 103 in a predetermined area of the camera controlscreen 400 displayed in the display unit 104.

The operation unit 105 is a user interface for operating the PC 100.Further, the operation unit 105 includes, as an operation means foroperating PC 100, pointing devices such as a mouse 105 a, a tablet, atrackball, and a trackpad, and a keyboard 105 b.

By operating these pointing devices, a user can control the PC 100 whilethe mouse pointer 500 moves on the menu screen. The mouse pointer 500 isoverlapped on the menu screen, and an operation is performed on thebutton or the scroll bar. For example, the coordinate of the mousepointer 500 changes according to the position information of thepointing devices, and the position of the mouse pointer 500 on the menuscreen is moved. When the pointing device is clicked (pressed), themouse pointer 500 performs inputting, and process is performedcorresponding to an area in which the mouse pointer 500 is displayed.

Similarly, by operating the keyboard 105 b, a user can control the PC100 while the mouse pointer 500 moves on the menu screen. The mousepointer 500 is overlapped on the menu screen, and an operation isperformed on the button or the scroll bar. For example, the useroperates a cross key of the keyboard 105 b to move the position of themouse pointer 500, and presses an Enter key of the keyboard 105 b toperform inputting by the mouse pointer 500.

FIG. 3 illustrates the camera control screen 400 as one example of amenu screen. When a user executes software which operates the camera 200in a windows system normally used in an operating system (OS) of the PC100, the camera control screen 400 is displayed on the display unit 104.

The camera control screen 400 is a window for remotely controlling thecamera 200. The camera control screen 400 includes a view area 401, astatus display area 402, and a parameter area 403. The CPU 101 performscontrol to display the data received from the camera 200 in thecommunication unit 103 on the view area 401 and the parameter area 403respectively.

In addition, in the camera control screen 400, when a user operates themouse pointer 500 to overlap it on a predetermined area or clicks(presses) the pointing device, the CPU 101 generates a command forcontrolling the camera 200.

The view area 401 is an image display area for displaying image datawhich the communication unit 103 receives from the camera 200. The viewarea 401 displays a live view image which is moving image datacontinuously transmitted from the camera 200, or displays still imagedata after shooting which is transmitted from the camera 200. On thelive view image displayed in the view area 401, range-finding frames ato e are superimposed. The number of the range-finding frames is notlimited to the number of range-finding frames illustrated in FIG. 3. Therange-finding frames a to e will be described below.

By performing an operation on the range-finding frames a to e by themouse pointer 500, a user can control the camera 200 to perform processconcerning the shooting. The shooting process includes a shootingpreparation and the shooting. The shooting preparation is process whichthe camera 200 performs in a state S1 where a shutter button of thecamera 200 is half-pressed. The shooting is process which the camera 200performs in a state S2 where the shutter button of the camera 200 isfull-pressed.

When an operation mode of the camera 200 is a normal image capture mode,and when the mouse pointer 500 is overlapped on at least one of therange-finding frames a to e, the PC 100 transmits, to the camera 200, ashooting preparation command for instructing the camera to start theshooting preparation. The camera 200 which has received the shootingpreparation command from the PC 100 executes the shooting preparationprocess corresponding to a range-finding area surrounded by one of therange-finding frames a to e on which the mouse pointer 500 isoverlapped.

When the camera 200 is in a image capture mode, and when a pointingdevice is clicked (pressed) in a state where the mouse pointer 500 isoverlapped on one of the range-finding frames from a to e, the PC 100transmits the shooting command for instructing the camera to startshooting process, to the camera 200. The camera 200 which has receivedthe shooting command from the PC 100 executes the shooting process.However, if the pointing device is clicked (pressed) while the mousepointer 500 is in an area other than the range-finding frames a to e,the PC 100 does not instruct the camera 200 to start a shootingpreparation and the shooting. In this case, the camera 200 does notexecute the shooting preparation and the shooting. The shootingpreparation process and the shooting process will be described below.When the communication unit 103 cannot perform data communication withthe camera 200, or when the camera 200 does not transmit image data,image data is not displayed in the view area 401.

The status display area 402 is an area displaying a state of the camera200 with character information. In FIG. 3A, the status display area 402displays “READY FOR SHOOTING”. In addition to this, as illustrated inFIG. 3B, the status display area 402 displays “AUTO-FOCUS (AF) ISOPERATING”, “AUTOMATIC EXPOSURE (AE) IS OPERATING”, or “IN SHOOTINGPROCESS”. The memory 102 records the character information indicatingthe state of the camera 200, such as “READY FOR SHOOTING”, “AF ISOPERATING”, “AE IS OPERATING”, and “IN SHOOTING PROCESS”.

The CPU 101 displays the character information read from the memory 102according to the state of the camera 200 in the status display area 402.When the communication unit 103 cannot perform data communication withthe camera 200, the status display area 402 displays informationindicating that shooting cannot be performed or communication with thecamera 200 cannot be performed.

The parameter area 403 is an area displaying shooting parametersindicating setting of the camera 200 at a time of shooting. The shootingparameters are an operation mode, a shutter speed, a diaphragm value,and a white balance value, and these are displayed in a parameter area403. These values are included in auxiliary data received from thecamera 200. In the parameter area 403, setting of the camera 200 otherthan the shooting parameter can be displayed. When the communicationunit 103 cannot perform data communication with the camera 200, theparameter area 403 does not display the shooting parameter.

The camera 200 is an image source capable of transmitting video data,audio data, and auxiliary data to the PC 100 via the USB cable 300.Further, the camera 200 receives a control command from the PC 100 viathe USB cable 300, and executes process corresponding to the controlcommand.

As illustrated in FIG. 2, the camera 200 includes a CPU 201, a memory202, a recording unit 203, a communication unit 204, an operation unit205, a display unit 206, an image processing unit 207, and imaging unit208.

The camera 200 has operation modes such as an image capture mode and aplayback mode. When the operation mode of the camera 200 is the imagecapture mode, the camera 200 can shoot an object, and can record shotimage data such as moving image data or still image data in a recordingmedium 203 a. When the operation mode of the camera 200 is a playbackmode, the camera 200 can playback image data selected by a user from therecording medium 203 a.

The CPU 201 controls an operation of the camera 200 according to acontrol program stored in the memory 202. The CPU 201 acquiresinformation relating the PC 100 from the PC 100 via the USB cable 300,and stores the information in the memory 202. In addition, a work areaof the CPU 201 is not limited to the memory 202. The work area can be anexternal storage apparatus such as a hard disk device.

The memory 202 functions as a work area of the CPU 201, and storesvarious values, data, and information which are used in the CPU 201. Theinformation stored in the memory 202 includes a control program forcontrolling the camera 200, and predetermined image data, and an iconwhich are displayed in the display unit 206.

The communication unit 204 includes a terminal for connecting the USBcable 300. When an operation mode of the camera 200 is an image capturemode, the imaging unit 208 shoots an object, and generates image datafrom an optical image of the object. The image data generated by theimaging unit 208 is supplied to the communication unit 204, the imageprocessing unit 207, and the display unit 206. Audio data generated by amicrophone unit which is not illustrated is also supplied to therecording unit 203 and the communication unit 204. The communicationunit 204 transmits the image data generated by the image processing unit207, the audio data generated by the microphone unit which is notillustrated, and auxiliary data generated by the CPU 101, to the PC 100via the USB cable 300. The communication unit 204 transmits a commandgenerated by the CPU 201 to the PC 100 via the USB cable 300.

Further, the communication unit 204 receives a command transmitted fromthe PC 100 via the USB cable 300. When the communication unit 204 hasreceived the command from the PC 100, the communication unit 204supplies the received command to the CPU 101.

The operation unit 205 is a user interface for operating the camera 200,and includes a plurality of buttons for operating the camera 200. A userinputs instruction into the CPU 201 via the operation unit 205. Each ofbuttons in the operation unit 205 is configured with a switch panel or atouch panel. The operation unit 205 includes a shutter button, a powersupply button, a start/stop button, a mode change button, a menu button,a cross button, and a setting (SET) button.

The shutter button has two states, i.e., a state 51 where the shutterbutton is half-pressed, and a state S2 where the shutter button isfull-pressed. When an operation mode of the camera 200 is an imagecapture mode, and when the shutter button is pressed to be in the state51, a signal for instructing the camera to perform the shootingpreparation process is transmitted from the operation unit 205 to theCPU 201, and is input to the CPU 201. The CPU 201 instructs the imageprocessing unit 207 and the imaging unit 208 to start the shootingpreparation process.

When an operation mode of the camera 200 is an image capture mode, andwhen the shutter button is pressed to be in the state S2, a signal forinstructing the camera to perform the shooting process is transmittedfrom the operation unit 205 to the CPU 201, and is input to the CPU 201.The CPU 201 instructs the image processing unit 207 and the imaging unit208 to start an operation of a series of shooting process.

The power supply button is a button for instructing the CPU 201 tochange a state of the camera 200 to a state where a power supply isturned on (ON) or off (OFF). The state where the power supply is turnedon is a state which can supply needed power to each of units of thecamera 200 from a power supply (not illustrated) such as a battery or analternating current (AC) power supply. The state where the power supplyis turned off is a state which stops to supply power to a part or entireof the camera 200 from a power supply (not illustrated) such as abattery or an AC power supply.

The moving image data is generated by the image processing unit 207 andthe imaging unit 208. The start/stop button is a button for instructingthe CPU 201 to start or pause recording of moving image data in therecording medium 203 a.

The mode change button is a button for instructing the CPU 201 to changethe operation mode of the camera 200 to one of an image capture mode, aplayback mode, a valve image capture mode, and a continuous imagecapture mode.

The image capture mode is a single shooting mode to generate one stillimage data by the image processing unit 207 and the imaging unit 208when the shutter button comes to be in the state S2. The valve imagecapture mode is a shooting mode to perform exposure for a long timewhile opening a shutter, and generate still image data, while theshutter button is in the state S2. The continuous image capture mode isa shooting mode to continuously generate still image data while theshutter button is in the state S2.

The menu button is a button for instructing the CPU 201 to display ornot to display a menu screen of the camera 200. The menu screen of thecamera 200 includes a menu screen for controlling the camera 200, and amenu screen for changing setting of the camera 200. The memory 202stores these menu screens.

The operation unit 205 includes a play button, a stop button, a pausebutton, a fast-forward button, and a rewind button. These buttonsinstruct the CPU 201 to execute operations of play, stop, pause, fastforward, and rewind of image data recorded in the recording medium 203a.

The display unit 206 is configured with a liquid crystal display. Whenan operation mode of the camera 200 is an image capture mode, thedisplay unit 206 displays image data generated by the image processingunit 207. When an operation mode of the camera 200 is a playback mode,the display unit 206 displays image data which the recording unit 203playbacks from the recording medium 203 a.

The image processing unit 207 performs image process, such as pixelinterpolating and color conversion, on the image data output from theimaging unit 208 or the image data read from the recording medium 203 aby the recording unit 203. The image processing unit 207 includes acompression/expansion circuit, which compresses and expands the imagedata by adaptive discrete cosine transform (ADCT). The image processingunit 207 reads the image data stored in the memory 202, and performscompression or expansion on the image data.

The image processing unit 207 performs arithmetic process using theimage data output from the imaging unit 208. Based on the arithmeticresult, the CPU 101 controls through-the-lens (TTL) type auto-focus(hereinafter referred to as AF), an automatic exposure ((hereinafterreferred to as AE), an electronic flash preliminary emission, and a TTLtype auto white balance process.

The imaging unit 208 includes an image sensor, an analog/digital (A/D)conversion unit, and an optical system. The optical system is a shootinglens group. The shooting lens group includes a variator lens for raisinga magnification of shooting, a focusing lens for adjusting a focus, adiaphragm for adjusting shooting light quantity, and a drive circuit fordriving those.

The image sensor converts object light entering via the optical systemto an image signal which is an electrical signal. The image sensor is,for example, a charge coupled device (CCD) image sensor and acomplementary metal-oxide-semiconductor (CMOS) sensor. The A/Dconversion unit converts an image signal (analog data) output from theimage sensor to digital moving image data (image data), and outputsthese data to the communication unit 204 or the image processing unit207.

When the CPU 201 instructs the image processing unit 207 and the imagingunit 208 to start shooting preparation process, the CPU 201 controls theimaging sensor, A/D conversion unit, and the optical system in theimaging unit 208, and performs AF process and AE process. Further, theshooting preparation process includes, for example, electronic flashpreliminary emission (hereinafter referred to as EF), auto white balance(hereinafter referred to as AWB), and image stabilization.

The AF process is process in which the CPU 201 performs position controlof the focus lens in the imaging unit 208. In the AF process, the CPU201 detects an in-focus position of the focus lens and adjusts theposition of the focus lens. More particularly, while moving the focuslens from a position corresponding to an infinite distance to a positioncorresponding to the closest distance set by each operation mode, theCPU 201 controls the imaging sensor to acquire a plurality of imagesignals. Then, the CPU 201 controls the memory 202 to store measurementdata and/or shooting parameters, and performs control to adjust theposition of the focus lens (the in-focus position). The in-focusposition is a position at which a high-frequency component extractedfrom the image signal comes to be the maximum.

In the AE process, a light metering value is acquired using thearithmetic result in the image processing unit 207 and exposure becomesproper. More particularly, the image processing unit 207 divides oneframe of the image data output from the imaging unit 208 into aplurality of areas (for example, 16×16), integrates a red-green-blue(RGB) signal for every divided area, and provides the integrated valueto the CPU 201.

The CPU 201 detects a degree of brightness of an object (an objectluminance) based on the integrated value, and calculates a value ofexposure which is the most proper for shooting. According to theexposure value, the CPU 201 determines a diaphragm value and a shutterspeed. According to this operation, the CPU 201 controls the imagingsensor and the optical system, and acquires the proper amount ofexposure. Further, when the CPU 201 determines that the exposure isproper, measurement data and/or shooting parameters such as thediaphragm value and the shutter speed are stored in the memory 202.

When the AF process and AE process are executed, in order to execute theAF process and the AE process at high speed, the AF process and the AEprocess can be performed in a range-finding area which is a pixel regionpartially selected from the entire pixel region of the imaging sensor. Aframe surrounding the range-finding area is termed a range-findingframe. The image processing unit 207 calculates focus informationrelating to the range-finding frame from shooting parameters stored inthe memory 202. Then, the image processing unit 207 superimposes therange-finding frame on the image data output from the imaging unit 208,and outputs the data. Therefore, the display unit 206 displays the imagedata on which the range-finding frame is superimposed.

Further, the image processing unit 207 adds the focus information to theimage data output from the imaging unit 208, and outputs the image datato the communication unit 204. The image processing unit 207 can output,to the communication unit 204, the image data on which the range-findingframe is superimposed. The focus information includes coordinateinformation of the range-finding frame relative to the image data, anarea of a region surrounded by the range-finding frame relative to theimage data, and the number of the range-finding frames. In addition, thenumber of the range-finding frames superimposed on the image data andthe position of the image data on which the range-finding frame issuperimposed are not limited to examples illustrated in FIG. 3.

When one of the range-finding frames a toe displayed in the display unit206 is selected, the CPU 201 performs the AF process. In the AF process,the CPU 201 detects an in-focus position, in which a high-frequencycomponent extracted from an image signal of an area surrounded by theselected range-finding frame is the maximum, and then adjusts theposition of the focus lens.

Further, when one of the range-finding frames a to e displayed in thedisplay unit 206 is selected, the CPU 201 calculates an exposure valueproper for shooting from a pixel area of the region surrounded by theselected range-finding frame based on the integrated value which isacquired by integrating the RGB signal. Then, the CPU 201 determines adiaphragm value and a shutter speed.

The EF process is process performed by the CPU 201 when the CPU 201determines that flash is necessary according to the results of diaphragmvalue and shutter speed, which are determined by performing the AEprocess. When the CPU 201 determines that flash is necessary, a flashflag is set, and the flash is charged. The EF process includes afunction of projecting AF auxiliary light and a flash light adjustmentfunction.

The AWB process makes a color balance of a flash shooting image properby measuring a color temperature of external light and a ratio of lightamounts of external light and flash light from the recorded image. Theimage processing unit 207 calculates an average integrated value bycolor of the RGB signal for every divided area, and provides thecalculated result to the CPU 201.

The CPU 201 receives the integrated value of red R, the integrated valueof blue B, and the integrated value of green G, and acquires ratios ofR/G and B/G for every divided area. The CPU 201 determines a kind oflight source based on distributions of the values of R/G and B/G incolor spaces of coordinates of a R/G axis and a B/G axis. The CPU 201controls a correction value of white balance as to the R, G, and Bsignals according to the determined kind of light source, and then theCPU 201 corrects signals of each color channel. The corrections value ofwhite balance as to the R, G, and B signals is stored in the memory 202.

The shooting preparation process is described above. Other process whichis preferably executed before the shooting process may be performed asthe shooting preparation process other than the aforementioned process.Further, the AWB process can be performed between the shootingpreparation process and the shooting process.

When the CPU 201 instructs the image processing unit 207 and the imagingunit 208 to start the shooting process, the CPU 201 controls the imageprocessing unit 207 and the imaging unit 208, and the shooting processis performed. After analog data output from the imaging sensor of theimaging unit 208 is converted to digital moving image data in the A/Dconversion unit, the converted data is output as digital still imagedata to the imaging processing unit 207. Then, the image processing unit207 compresses the digital still image data, and the compressed data iswritten in the recording medium 203 a as still-image data.

The image capture apparatus 200 is not limited a digital single lensreflex camera. For example, the image capture apparatus 200 can be avideo camera, a digital still camera, or a camera-equipped mobile phone.

Process performed by the camera 200 in the control system will bedescribed with reference to FIGS. 1, 2, and 4. FIG. 4 is a flowchartillustrating an example of process executed when the operation mode ofthe camera 200 according to the first exemplary embodiment is an imagecapture mode. The flowchart illustrated in FIG. 4 is executed when thePC 100 and the camera 200 are communicable via the USB cable 300 andwhen the power supplies of the PC 100 and the camera 200 are turned on.The CPU 201 controls the process illustrated with the flowchart in FIG.4 by executing the control program stored in the memory 202. The processillustrated with the flowchart of FIG. 4 is executed when the operationmode of the camera 200 is an image capture mode.

When software for remotely controlling the camera 200 by a useroperation is designated on the PC 100 and the software is executed, thePC 100 transmits the operation mode confirmation signal to confirm theoperation mode of the camera 200. Thus, in step S401, the CPU 201determines whether the communication unit 204 has received the operationmode confirmation signal. When the CPU 201 determines that thecommunication unit 204 has received the operation mode confirmationsignal (YES in step S401), the present flow chart proceeds to step S402from step S401. When the CPU 101 determines that the communication unit103 has not received the operation mode confirmation mode signal (NO instep S401), the present flow chart returns to step S401 from step S401.

In step S402, the CPU 201 generates an image capture mode signal whichindicates that the operation mode of the camera 200 is a normal imagecapture mode (a single shooting mode), and outputs the image capturemode signal to the communication unit 204. The CPU 201 outputs the imagecapture mode signal to the communication unit 204 to control thecommunication unit 204 to transmit the image capture mode signal to thePC 100. When the communication unit 204 transmits the image capture modesignal to the PC 100, the present flowchart proceeds to step S403 fromstep S402. In addition, when the operation mode of the camera 200 is thevalve image capture mode or the continuous image capture mode other thanthe image capture mode, the CPU 201 generates a valve image capture modesignal or a continuous image capture mode signal, and transmits thesignal to the PC 100 similar to the image capture mode signal.

In step S403, the CPU 201 determines whether the communication unit 204has received a moving image data request signal from the PC 100. Whenthe CPU 201 determines that the communication unit 204 has received themoving image data request signal (YES in step S403), the present flowchart proceeds to step S404 from step S403. When the CPU 201 determinesthat the communication unit 204 has not received the moving image datarequest signal (NO in step S403), the present flow chart returns to stepS403 from step S403.

In step S404, the CPU 201 instructs the image processing unit 207 to addthe focus information to the image data. The CPU 201 controls the imageprocessing unit 207 to output, to the communication unit 204, the imagedata to which the focus information is added. Then, the image processingunit 207 continuously outputs the image data to the communication unit204 until the CPU 201 issues an instruction for performing the shootingprocess. Thus, the CPU 201 controls the communication unit 204 totransmit, to the PC 100 via the USB cable 300, the image data which iscontinuously output, as moving image data, and the focus informationadded to the image data as auxiliary data. When the communication unit204 transmits the moving image data and the auxiliary data to the PC100, the present flow chart proceeds to step S405 from step S404.

In the present exemplary embodiment, when the communication unit 204transmits the moving image data corresponding to the moving imagetransmission request coming from the PC 100, the communication unit 204transmits the focus information only at a time of starting transmission.Further, the CPU 201 issues an instruction to the image processing unit207 and controls the image processing unit 207 to output, to thecommunication unit 204, an image data to which the focus information andthe range-finding frame are added, and then the image processing unit207 may continuously output, to the communication unit 204, the imagedata to which the range-finding frame is added, until the CPU 201 issuesan instruction for performing the shooting process. In this condition,the communication unit 204 transmits a message to the PC 100 as anauxiliary data, indicating that an image in the range-finding frame ismultiplexed on the image data and transmitted.

In step S404, when the PC 100 receives a notification that an operationmode of the camera 200 is an image capture mode, a user can determine inthe display unit 104 that the camera 200 is in a state controllable bythe PC 100. Thus, when the PC 100 receives the notification that theoperation mode of the camera 200 is the image capture mode, a user mayoperate the PC 100 to generate a control command for controlling thecamera 200 and the PC 100 transmits the control command to the camera200.

Therefore, in step S405, the CPU 201 determines whether thecommunication unit 204 has received a shooting preparation command. Whenthe CPU 201 determines that the communication unit 204 has received theshooting preparation command, the CPU 201 sets a shooting preparationflag in the memory 202. For example, when the range-finding frame b isselected and the communication unit 204 receives the shootingpreparation command corresponding to the range-finding frame b, the CPU201 sets, in an item of the range-finding frame b in the memory 202, theshooting preparation flag indicating that an area surrounded by therange-finding frame b is selected as the range-finding area for whichthe shooting preparation process is executed.

After the CPU 201 sets the shooting preparation flag in the memory 202(YES in step S405), the flowchart proceeds to step S406 from step S405.After the CPU 201 determines that the communication unit 204 has notreceived the shooting preparation command (NO in step S405), theflowchart returns to step S405 from step S405.

In step S406, the CPU 201 performs the shooting preparation process bycontrolling the image processing unit 207 and the imaging unit 208according to the pixel region of the area surrounded by one of therange-finding frames a to e corresponding to the shooting preparationflag set in the memory 202. As an example, a case that the range-findingframe b corresponds to the shooting preparation flag set in the memory202 will be described. As for the AF process, the CPU 201 reads an imagesignal from the pixel region of the area surrounded by the range-findingframe b, extracts a high-frequency component from the image signal,detects the in-focus position of the focus lens at which thehigh-frequency component is maximum, and adjusts the position of thefocus lens.

Further, as for the AE process, the CPU 201 integrates RGB signals fromthe pixel region of the area surrounded by the range-finding frame b,calculates an exposure value proper for shooting based on the integratedvalue, and determines a diaphragm value and a shutter speed. After theshooting preparation process is performed in the image processing unit207 and the imaging unit 208, the flowchart proceeds to step S407 fromstep S406.

In step S407, the CPU 201 reads, from the memory 202, shootingparameters such as the shutter speed, the diaphragm value, and a whitebalance value, outputs the shooting parameters to the communication unit204, and controls the communication unit 204 to transmit the shootingparameters to the PC 100. When the communication unit 204 transmits theshooting parameters to the PC 100, the flowchart proceeds to step S408from step S407.

After the PC 100 transmits a shooting preparation command to the camera200, the PC 100 may transmit a shooting command for making the camera200 to perform the shooting process. In this case, in step S408, the CPU201 determines whether the communication unit 204 has received theshooting command from the PC 100.

When the CPU 201 determines that the communication unit 204 has receivedthe shooting command, the CPU 201 sets a shooting flag in the memory202. When the CPU 201 sets the shooting flag in the memory 202 (YES instep S408), the flowchart proceeds to step S409 from step S408. When theCPU 201 determines that the communication unit 204 has not received theshooting command, the flowchart proceeds to step S411 from step S408.

In step S409, the CPU 201 controls the imaging unit 208 to performshooting process. The imaging unit 208 shoots still image data of oneframe according to a command, and holds the shot still image data in thememory 202. Then, the image processing unit 207 performs theaforementioned process on the shot still image data, and the recordingunit 203 creates a still image file including the still image data, andstores the still image file in the recording medium 203 a.

When the imaging unit 208 performs shooting process, the CPU 201 resetsa shooting preparation flag and a shooting flag in the memory 202. Whenthe CPU 201 resets the shooting preparation flag and the shooting flagin the memory 202, the flowchart proceeds to step S410 from step S409.

In step S410, when the still image data shot by the camera 200 is readyfor transmitting to the PC 100, the CPU 201 reads the still image filerecorded by the received shooting command, from the recording medium 203a by the recording unit 203, and outputs the file to the communicationunit 204. The CPU 201 controls the communication unit 204 so as totransmit the read still image file to the PC 100. When the communicationunit 204 transmits the still image file to the PC 100, the flowchartreturns to step S405 from step S410.

In step S411, the CPU 201 determines whether the communication unit 204has received a shooting preparation reset command. When the CPU 201determines that the communication unit 204 has not received the shootingpreparation reset command (NO in step S411), the flowchart proceeds tostep S408 from step S411. When the CPU 201 determines that thecommunication unit 204 has received the shooting preparation resetcommand (YES in step S411), the CPU 201 resets a shooting preparationflag in the memory 202, and controls the image processing unit 207 andthe imaging unit 208 to cancel the shooting preparation process.

The image processing unit 207 and the imaging unit 208 interrupts the AFprocess, the AE process, the EF process, and the AWB process, whileholding the shooting parameters, such as the in-focus position, theshutter speed, the diaphragm value, and the white balance correctionvalue, which are acquired by the shooting preparation process performeduntil canceling the process.

When the CPU 201 controls the image processing unit 207 and the imagingunit 208 to perform the shooting preparation process again, the imageprocessing unit 207 and the imaging unit 208 restart the interruptedprocess, such as the AF process, the AE process, the EF process, and theAWB process, continuing again the process which is interrupted. When theCPU 201 resets the shooting preparation flag set in the memory 202 instep S405 (NO in step S411), the flowchart returns to step S405 fromstep S411.

The process from step S401 to step S410 is not performed when theoperation mode of the camera 200 is an operation mode other than theimage capture mode.

The focus information added to the image data and transmitted to the PC100 may be transmitted to the PC 100 when the focus lens in an in-focusstate in the shooting preparation process and when the shootingpreparation process ends.

Process performed in the PC 100 according to the first exemplaryembodiment will be described with reference to FIGS. 1 to 3 and 5. FIG.5 is a flowchart illustrating an example of process performed by the PC100 according to the first exemplary embodiment. The process illustratedin the flowchart in FIG. 5 is executed in a state where the PC 100 andthe camera 200 are communicable via the USB cable 300 and when the powersupplies of the PC 100 and the camera 200 are turned on. The processillustrated in the flowchart in FIG. 5 is executed when an operationmode of the camera 200 is an image capture mode, and is not executedwhen the operation mode of the camera 200 is an operation mode otherthan the image capture mode. The CPU 101 controls the processillustrated in the flowchart in FIG. 5 by executing a control programstored in the memory 102. In the first exemplary embodiment, a mouse 105a is used to operate the mouse pointer 500 as an example of a pointingdevice for operating the mouse pointer 500.

When a user executes software for remotely controlling the camera 200 onthe PC 100 in a state where a PC control screen is displayed in thedisplay unit 104, the CPU 101 acquires a camera control screen 400 fromthe memory 102 and controls the display unit 104 to display the controlscreen 400. In this case, nothing is displayed in the view area 401, thestatus display area 402, and the parameter area 403 on the cameracontrol screen 400. If a user operates the PC 100 and controls thecamera 200 to shoot, the CPU 101 needs to determine whether the camerais ready for shooting.

In step S501, the CPU 101 generates an operation mode confirmationsignal for confirming the operation mode of the camera 200, and outputsthe operation mode confirmation signal to the communication unit 103.The CPU 101 controls the communication unit 103 to transmit theoperation mode confirmation signal to the camera 200 via the USB cable300. When the communication unit 103 transmits the operation modeconfirmation signal to the camera 200, the flowchart proceeds to stepS502 from step S501.

When the camera 200 has received the operation mode confirmation signal,the camera 200 generates a mode signal indicating a current operationmode, and transmits the mode signal to the PC 100.

In step S502, in order to determine whether an operation mode of thecamera 200 is an image capture mode, the CPU 101 determines whether thecommunication unit 103 has received an image capture mode signal fromthe camera 200. When the communication unit 103 has received the imagecapture mode signal from the camera 200, the CPU 101 sets a “IMAGECAPTURE MODE” flag in the memory 102 as information indicating theoperation mode of the camera 200. After setting the “IMAGE CAPTURE MODE”flag, the CPU 101 controls the MODE in the parameter area 403 to display“Av mode”, and controls the status display area 402 to display “READYFOR SHOOTING” as illustrated in FIG. 3A.

In the present exemplary embodiment, process performed when an operationmode of the camera 200 is a normal image capture mode is described.However, process may also be performed when the operation mode of thecamera 200 is the continuous image capture mode or the valve imagecapture mode.

In addition, when the communication unit 103 has received a continuousimage capture mode signal, the CPU 101 controls the MODE in theparameter area 403 to display “Continuous image capture mode”. When thecommunication unit 103 has received a valve image capture mode signal,the CPU 101 controls the MODE in the parameter area 403 to display“Valve mode”. Further, if the communication unit 103 has received one ofthe image capture mode signal, the continuous image capture mode signal,and the valve image capture mode signal, the CPU 101 controls the statusdisplay area 402 to display “READY FOR SHOOTING”.

When the CPU 101 determines that the communication unit 103 has receivedthe image capture mode signal (YES in step S502), the flowchart proceedsto step S503 from step S502. When the CPU 101 determines that thecommunication unit 103 has not received the image capture mode signal(NO in step S502), the flowchart returns to step S502 from step S502.Further, when the communication unit 103 receives a signal indicating adifferent operation mode from the image capture mode signal, forexample, a playback mode signal indicating that the operation mode ofthe camera 200 is a playback mode, the CPU 101 also determines that thecommunication unit 103 has not received the image capture mode signal.Also in this case, the flowchart returns to step S502 from step S502.

In step S503, the CPU 101 generates an image data request signal forrequesting, to the camera 200, a live view image and focus informationwhich are generated by the camera 200. Then, the CPU 101 controls thecommunication unit 103 to transmit the image data request signal to thecamera 200. When the communication unit 103 transmits the image datarequest signal, the flowchart proceeds to step S504 from step S503.

When the camera 200 receives the image data request signal, the camera200 transmits, to the PC 100, continuous image data output from theimaging unit 208 and focus information added to the image data. Thecontinuous image data is transmitted as moving image data and the focusinformation is transmitted as auxiliary data.

Therefore, in step S504, in order to determine whether the communicationunit 103 can receive the moving image data from the camera 200, the CPU101 determines whether the communication unit 103 has received themoving image data and the auxiliary data. When the communication unit103 has received the moving image data and the auxiliary data from thecamera 200, the CPU 101 supplies, to the display unit 104, the movingimage data which the communicated unit 103 has received, and analyzesthe auxiliary data which the communication unit 103 has received. Basedon the analyzed auxiliary data, the CPU 101 acquires focus informationrelating to the moving image data which the communication unit 103 hasreceived. The CPU 101 superimposes a range-finding frame on the movingimage data according to the focus information, and displays the movingimage data in the view area 401 as illustrated in FIG. 3A. Hence, thelive view image of the camera 200 is displayed in the view area 401.

In addition, when the image of the range-finding frame is multiplexed onthe image data transmitted from the camera 200, the PC 200 does notdisplay the range-finding frame. Since the camera 200 transmits dataindicating whether the range-finding frame is multiplexed on the imagedata, as the auxiliary data added to the image data, the PC 200 candetermine whether the range-finding frame is multiplexed on the imagedata using the auxiliary data.

When the view area 401 displays the live view image received from thecamera 200 (YES in step S504), the flowchart proceeds to step S505 fromstep S504. When the CPU 101 determines that the communication unit 103has not received the moving image data or the auxiliary data from thecamera 200, the CPU 101 displays, in the status display area 402,information indicating that shooting cannot be performed by the camera200 or communication with the camera 200 cannot be performed. When thestatus display area 402 displays the information indicating thatshooting cannot be performed by the camera 200 or communication with thecamera 200 cannot be performed, the flowchart ends. Further, processsimilar to the present exemplary embodiment is also performed when thecommunication unit 103 cannot receive the moving image data and theauxiliary data.

In step S505, the CPU 101 determines whether the mouse pointer 500exists in the range-finding area surrounded by each of the range-findingframes a to e. For example, as illustrated in FIG. 3B, when a useroperates the mouse 105 a in the operation unit 105, on the cameracontrol screen 400 so as to overlap the mouse pointer 500 on therange-finding frame b (this operation is termed mouse over), the CPU 101determines that the mouse pointer 500 exists in the range-finding frameb.

An example that a user operates the mouse 105 a in the operation unit105, on the camera control screen 400 so as to overlap the mouse pointer500 on the range-finding frame b (mouse over) will be described.

The CPU 101 acquires coordinate information of the mouse pointer 500,and coordinate information of the range-finding frames a to e acquiredas first information from focus information received from the camera 200in step S504. The CPU 101 determines whether the coordinate informationof the mouse pointer 500 acquired as second information exists in anarea surrounded by one of the range-finding frames a to e.

When the CPU 101 determines that the coordinate information of the mousepointer 500 exists in the area surrounded by the range-finding frame b(YES in step S505), the flowchart proceeds to step S506 from step S505.When the CPU 101 determines that the coordinate information of the mousepointer 500 does not exist in the area surrounded by one of therange-finding frames a to e (NO in step S505), the flowchart returns tostep S505 from step S505.

In step S506, when the CPU 101 determines that the mouse pointer 505exists in the area surrounded by one of the range-finding frames a to e,the range-finding frame b on which the mouse pointer 500 is overlappedis surrounded by a black frame as illustrated in FIG. 3B. In addition,the range-finding frame on which the mouse pointer 500 is overlapped canbe surrounded by a frame of other color instead of the black frame, orthe color of the entire range-finding frame can be changed instead ofsurrounding the range-finding frame with the black frame.

When the range-finding frame on which the mouse pointer 500 isoverlapped is the range-finding frame b, the CPU 101 generates ashooting preparation command for using the camera 200 to performshooting preparation, and outputs the shooting preparation command tothe communication unit 103. The shooting preparation commandcorresponding to the range-finding frame b includes an instruction ofthe shooting preparation to the camera 200, and information indicatingthat the range-finding frame b is selected from one of the range-findingframes a to e. The CPU 101 controls the communication unit 103 totransmit the shooting preparation command to the camera 200.

Accordingly, when the CPU 101 determines that the mouse pointer 500exists in the area surrounded by one of the range-finding frames a to e,the CPU 101 generates a shooting preparation command for using thecamera 200 to perform the shooting preparation corresponding to therange-finding frame in which the mouse pointer 500 exists. When thecommunication unit 103 transmits the shooting preparation command to thecamera 200, the flowchart proceeds to step S507 from step S506.

When the shooting preparation command is transmitted to the camera 200and the camera 200 performs the shooting preparation process, thecommunication unit 103 receives the shooting parameter. Based oninformation included in the shooting parameter which the communicationunit 103 receives, the CPU 101 can determine what kind of process isperformed by the camera 200 as the shooting preparation process.Therefore, the CPU 101 reads character information from the memory 102corresponding to the process which the camera 200 performs, and displaysthe character information in the status display area 402.

For example, when the camera 200 performs only the AF process, the CPU101 reads the character information from the memory 102, and displays“AF IS OPERATING” in the status display area 402. Similarly, when thecamera 200 performs only the AE process, the CPU 101 reads the characterinformation from the memory 102, and displays “AE IS OPERATING” in thestatus display area 402. Further, when the camera 200 performs only theAWB process, the CPU 101 reads the character information from the memory102, and can display “AWB IS OPERATING” in the status display area 402.

After the communication unit 103 transmits the shooting preparationcommand to the camera 200, and if the mouse pointer 500 still exists inthe area surrounded by the range-finding area in which it has beendetermined that the mouse pointer 500 exists in step S505, the camera200 continues to execute the shooting preparation process until thecamera 200 receives the shooting command. However, if the mouse pointer500 departs from the area surrounded by the range-finding area in whichit has been determined that the mouse pointer 500 exists in step S505,the camera 200 cancels the preparation shooting process. Similarly, whena user operates the mouser 105 a to overlap the mouse pointer 500 onother range-finding frame, the camera 200 cancels the shootingpreparation process.

Therefore, while the camera 200 performs the shooting preparationprocess, the CPU 101 needs to determine whether the mouse pointer 500still exists in the area surrounded by the range-finding frame where themouse pointer 500 has existed in step S505. Thus, in step S507, the CPU101 determines whether the mouse pointer 500 still exists in the areasurrounded by the range-finding frame in which it has been determinedthat the mouse pointer 500 exists in step S505. For example, the CPU 101determines whether the coordinate information of the mouse pointer 500exists in the area surrounded by the range-finding frame b, like in theprocess performed in step S505.

When the CPU 101 determines that the coordinate information the mousepointer 500 exists in the area surrounded (predetermined area) by therange-finding frame where the mouse pointer 500 existed in step S505(YES in step S507), the flowchart proceeds to step S508 from step S507.When the CPU 101 determines that the coordinate information of the mousepointer 500 does not exist in the area surrounded by the range-findingframe where the mouse pointer 500 existed in step S505 (NO in stepS507), the flowchart proceeds to step S509 from step S507.

In step S508, the CPU 101 determines whether a user clicks (presses) abutton of the mouse 105 a in the operation unit 105 for operating themouse pointer 500. When the CPU 101 determines that the user clicks(presses) the button of the mouse 105 a (YES in step S508), theflowchart proceeds to step S510 from step S508. When the CPU 101determines that the user does not click (press) the button of the mouse105 a (NO in step S508), the flowchart returns to step S507 from stepS508.

In step S509, the CPU 101 generates a shooting preparation reset commandfor resetting the shooting preparation process, and outputs the shootingpreparation reset command to the communication unit 103. The CPU 101controls the communication unit 103 to transmit the shooting preparationreset command to the camera 200. Further, the CPU 101 reads thecharacter information from the memory 102, and displays “READY FORSHOOTING” in the status display area 402. When the communication unit103 transmits the shooting preparation reset command, the flowchartreturns to step S505 from step S509.

In step S510, the CPU 101 generates a shooting command, and outputs theshooting command to the communication unit 103. The CPU 101 controls thecommunication unit 103 to transmit the shooting command to the camera200. Further, the CPU 101 reads the character information from thememory 102, and displays “SHOOTING IN PROCESS” in the status displayarea 402. When the communication unit 103 transmits the shooting commandto the camera 200, the flowchart proceeds to step S511 from step S510.

When the PC 100 transmits the shooting command to the camera 200, thecamera 200 executes the shooting process in step S409 in FIG. 4 and theprocess for transmitting a still image file in step S410 in FIG. 4.

Thus, in step S511, the CPU 101 determines whether the communicationunit 103 has received the still image file shot by the camera 200corresponding to the shooting command from the camera 200. When the CPU101 determines that the communication unit 103 has received thesill-image file from the camera 200 (YES in step S511), the flowchartproceeds to step S512 from step S511. When the CPU 101 determines thatthe communication unit 103 has not received the sill image file from thecamera 200 (NO in step S511), the flowchart returns to step S511 fromstep S511.

In step S512, the CPU 101 once stores, in the memory 102, the stillimage file which the communication unit 103 receives from the camera200. Then, the CPU 101 controls the display 104 to display the stillimage data included in the still image file for a predetermined periodof time. When the display unit 104 has displayed the still image datareceived from the camera 200 for a predetermined period of time, theflowchart returns to step S501 from step S512.

After the display unit 104 displays the still image data received fromthe camera 200 for a predetermined period of time, nothing is no longerdisplayed in the view area 401 and the status display area 402. Inaddition, the still image data received from the camera 200 is displayedin the view area 401 for 2 to 3 seconds. The predetermined period oftime is arbitrarily determined.

As described above, in the control system according to the firstexemplary embodiment, a user can control the camera 200 to shoot only byoperating a pointing device, such as the mouse 105 a, in the rangefinding frame on the live view screen, which is selected by the user.Therefore, a user can remotely control the camera 200 by a very smoothand easy operation, and can control the camera 200 to perform theshooting preparation process on the image data in the area surrounded bythe range-finding frame selected by the user, and the shooting process.Therefore, the user can designate a desired range-finding frame andcontrol the camera 200 to perform the shooting preparation correspondingto the designated range-finding frame. As a result, the user can acquirea desired image.

Further, since the user can control the camera 200 to perform theshooting process, while confirming the live view image in the remotecontrol system, the user can acquire a desired image.

In the first exemplary embodiment, a user designates the range-findingframe b by operating the mouse cursor 500 with the mouse 105 a in thecamera control screen 400, and controls the camera 200 to perform theshooting reparation process corresponding to the range-finding frame b.However, the operation is not limited to that. Even when a user operatesby the mouse 105 a to overlap the mouse cursor 500 on an area of one ofthe range-finding frames a and c to e other than the range-finding frameb, the camera 200 performs the similar shooting preparation process.

In the first exemplary embodiment, the user operates the mouse pointer500 by the mouse 105 a. However, other pointing devices, such as atablet, a trackball, and a trackpad, can be used, and the keyboard 105 bcan be also used. Further, the button of the mouse 105 a can be a rightside button or a left side button, or can be a scroll button.

Then, process performed in the PC 100 according to the second exemplaryembodiment of the present invention will be described with reference toFIGS. 1 and 6 to 8. In the second exemplary embodiment, common parts ofthe first exemplary embodiment will not be described, and only differentparts will be described.

The second exemplary example has a configuration including a facedetection unit 209 as illustrated in FIG. 6. When a face detectionfunction is set to be turned on by a menu button in the operation unit205, the camera 200 in the second exemplary embodiment can detect a faceof an object included in image data (when the object is a person) by theface detection unit 209.

The face detection unit 209 analyzes image data output from the imageprocessing unit, and performs a determination whether there is a personin an object in the image data. Further, when a person exists in anobject in the image data, the face detection unit 209 performs facedetection process, such as, a determination of a position and a size ofthe face part of the person. The face detection unit 209 outputsinformation relating the position and the size of the face of thedetected object to the CPU 201.

For example, the face detection unit 209 performs the face detectionprocess by flesh color detection. The flesh color detection includes thesteps of determining, in a color space for distinguishing a flesh colorfrom other colors, a range of the flesh color in the color space basedon information of the flesh color which is previously sampled, anddetermining whether a color of each pixel is in the determined range. Inaddition to this, a face detection method by edge detection or shapepattern detection can be used, and a face detection method by huedetection can be also used.

When the CPU 201 acquires the information indicating a position and asize of a face area from the face detection unit 209, the CPU 201 storesthe information in the memory 202, controls the range-finding frame soas to be positioned on the acquired face area, and controls the displayunit 206 to display the range-finding frame. The face detection unit 209continuously writes and updates, in the memory 202, the face informationindicating a position and a size of a face area until the imaging unit208 performs shooting.

Based on the face information detected by the face detection unit 209,the image processing unit 207 controls the range-finding frame so as tobe positioned on the face area, and outputs the range-finding frame tothe display unit 206. A range-finding frame controlled to be positionedon the face area is termed a face detection frame. The image processingunit 207 outputs the face detection frame to the display unit 206, andthe display unit 206 displays the face detection frame which issuperimposed on the image data displayed in the display unit 206.

In the first exemplary embodiment, when the mouse pointer 500 exists inan area surrounded by one of a plurality of range-finding frames, the PC100 transmits a shooting preparation command to the camera 200, and whena user clicks (presses) the button of the mouse 105 a, the PC 100transmits the shooting command to the camera 200.

However, in the second exemplary embodiment, when the mouse pointer 500exists in the area surrounded by the face detection frame f or g, the PC100 transmits a shooting preparation command to the camera 200. When themouse pointer 500 exists in the area surrounded by the face detectionframe for g, and when a user clicks (presses) the button of the mouse105 a, the PC 100 transmits the shooting command to the camera 200.

Therefore, in the second exemplary embodiment, the camera 200 transmits,to the PC 100, image data by adding to every frame of the image data,coordinate information of the face detection frame relative to the imagedata, a range of the area surrounded by the face detection framerelative to the image data, and the focus information including a numberof the face detection frame. The CPU 201 may also control thecommunication unit 204 to continuously transmit, to the PC 100, theimage data to which the focus information is added. Further, the CPU 201may also control the communication unit 204 to transmit, to the PC 100,the image data to which the focus information is added, when a focuslens is focused by the shooting preparation process and when theshooting preparation process is ended.

When the communication unit 204 has received the image data requestsignal, the CPU 201 can control the communication unit 204 to transmit,to the PC 100 via the USB cable 300, the image data on which the facedetection frame is superimposed.

The camera control screen 400 illustrated in FIG. 7 is one of menuscreens displayed in the display unit 104, and is stored in the memory102.

The view area 401 in the camera control screen 400 displays live viewimage data continuously received in the communication unit 103 from thecamera 200. On the live view image data, the face detection frames f andg surrounding the face area added by the camera 200 is displayedsuperimposed on the live view image.

Next, process performed in the PC 100 according to the second exemplaryembodiment will be described with reference to FIGS. 7 and 8.

FIG. 8 is a flowchart illustrating one example of process performed inthe PC 100 according to the second exemplary embodiment. Processillustrated in FIG. 8 is process executed when the PC 100 is connectedwith the camera 200 via the USB cable 300 and the power supplies of thePC 100 and the camera 200 are turned on. In addition, the CPU 101controls the process illustrated in the flowchart in FIG. 8 by executingthe control program stored in the memory 102.

The same numerals are added to the process of the flowchart illustratedin FIG. 8 which is similar to the process of the flowchart illustratedin FIG. 5, and detailed descriptions for the similar process will beomitted. Like the first exemplary embodiment, in the second exemplaryembodiment, an operation of the mouse pointer 500 is performed by themouse 105 a as one example of the pointing device for operating themouse pointer 500.

In step S805, the CPU 101 determines whether the mouse pointer 500exists in the face area surrounded by the face detection frame f or g.For example, when the mouse pointer 500 is operated on the cameracontrol screen 400 by the mouse 105 a to be overlapped on the facedetection frame f as illustrated in FIG. 7B, the CPU 101 determines thatthe mouse pointer 500 exists in the face detection frame f. In thesecond exemplary embodiment, a case that the mouse pointer 500 isoperated on the camera control screen 400 by the mouse 105 a to beoverlapped on the face detection frame f, is described as an example.

The CPU 101 acquires coordinate information of the mouse pointer 500,and coordinate information of the face detection frame f or g based onthe focus information received from the camera 200 in step S504. The CPU101 determines whether the acquired coordinate information of the mousepointer 500 exists in the area surrounded by the acquired face detectionframe f or g.

When the CPU 101 determines that the coordinate information of the mousepointer 500 exists in the area surrounded by the face detection frame for g (YES in step S805), the flowchart proceeds to step S806 from stepS805. When the CPU 101 determines that the coordinate information of themouse pointer 500 does not exist in the area surrounded by the facedetection frame f or g (NO in step S805), the flowchart returns to stepS805 from step S805.

In step S806, when the CPU 101 determines that the mouse pointer 500exists in the area surrounded by the face detection frame f or g, theface detection frame f on which the mouse pointer 500 is overlapped issurrounded by a black frame as illustrated in FIG. 7B. Further, when thecamera 200 performs the AF process, the CPU 101 reads the characterinformation from the memory 102, and displays “AF IS OPERATING” in thestatus display area 402. Furthermore, when the camera 200 performs theAE process, the CPU 101 displays “AE IS OPERATING” in the status displayarea 402. In addition, the face detection frame on which the mousepointer 500 is overlapped can be surrounded by a frame of other color,or the color of the entire face detection frame may be changed insteadof surrounding the range-finding frame with the black frame.

When the face detection frame on which the mouse pointer 500 isoverlapped is the face detection frame f, the CPU 101 generates theshooting preparation command for using the camera 200 to perform theshooting preparation process corresponding to the face detection frame,and outputs the command to the communication unit 103. The shootingpreparation command corresponding to the face detection frame f includesan instruction of the shooting preparation process to the camera 200,and information indicating that the face detection frame f is selectedfrom the face detection frames f and g.

The CPU 101 controls the communication unit 103 to transmit the shootingpreparation command to the camera 200. When the CPU 101 determines thatthe mouse pointer 500 exists in the area surrounded by the facedetection frame f or g, the CPU 101 generates the shooting preparationcommand for using the camera 200 to perform the shooting preparationprocess corresponding to the face detection frame in which the mousepointer 500 exists. After the communication unit 103 transmits theshooting preparation command to the camera 200, the flowchart proceedsto step S807 from step S806.

After the communication unit 103 transmits the shooting preparationcommand to the camera 200, if the mouse pointer 500 still exists in thearea surrounded by the predetermined face detection area (predeterminedarea) in which it has been determined that the mouse pointer 500 existsin step S805, the camera 200 continues to execute the shootingpreparation process until receiving the shooting command. However, ifthe mouse pointer 500 departs from the area surrounded by the facedetection area in which it has been determined that the mouse pointer500 exists in step S805, the camera 200 cancels the preparation shootingprocess. Similarly, when a user operates the mouse pointer 500 to beoverlapped on other face detection frame, the camera 200 cancels theshooting preparation process.

Therefore, while the camera 200 performs the shooting preparationprocess, the CPU 101 needs to determine whether the mouse pointer 500still exists in the area surrounded by the predetermined face detectionframe where the mouse pointer 500 has existed in step S805.

Thus, in step S807, the CPU 101 determines whether the mouse pointer 500still exists in the area surrounded by the predetermined face detectionframe in which it has been determined that the mouse pointer 500 existsin step S805. For example, the CPU 101 determines whether the coordinateinformation of the mouse pointer 500 exists in the area surrounded bythe face detection frame f, like in the process performed in step S805.

After the CPU 101 determines that the coordinate information of themouse pointer 500 exists in the area surrounded by the face detectionframe where the mouse pointer 500 has existed in step S805 (YES in stepS807), the flowchart proceeds to step S508 from step S807. After the CPU101 determines that the coordinate information the mouse pointer 500does not exist in the area surrounded by the face detection frame wherethe mouse pointer 500 has existed in step S805 (NO in step S807), theflowchart proceeds to step S809 from step S807.

Accordingly, when the mouse 105 a operates the mouse pointer 500 to beoverlapped on the area surrounded by the face detection frame f or g,the PC 100 can instruct the camera 200 to start the shooting preparationprocess. Then, when a user clicks (presses) the button of the moue 105 awhile the mouse pointer 500 is overlapped on the face detection frame for g by the mouse 105 a, the PC 100 instructs the camera 200 to startthe shooting process.

According to the remote control system of the second exemplaryembodiment, a user controls the camera 200 to shoot on the live viewimage only by operating the mouse 105 a in the face detection frameselected by the user. Therefore, the user can remotely control thecamera 200 by a smooth and easy operation, and can control the camera200 to perform the shooting preparation process on the image data in thearea surrounded by the face detection frame selected by the user and toperform the shooting process. Therefore, the user can designate adesired face detection frame and control the camera 200 to perform theshooting preparation process corresponding on the designated facedetection frame. As a result, the user can acquire a desired image.

Further, a user can control the camera 200 to perform the shootingprocess, while confirming the live view image in the remote controlsystem. Thus, the user can acquire a desired image.

In the second exemplary embodiment, the user designates the facedetection frame f by operating the mouse cursor 500 in the cameracontrol screen 400 using the mouse 105 a, and controls the camera 200 toperform the shooting reparation process corresponding to the facedetection frame f. However, the operation is not limited to that. Whenthe user operates, with the mouse 105 a, the mouse cursor 500 to beoverlapped on an area of the face detection frame g other than the facedetection frame f, the camera 200 performs the similar shootingpreparation process.

Further, the camera 200 can include a changeover unit capable ofswitching between the range-finding frame or the face detection frame inthe display. As a consequence, a user can control the changeover unit toperform a designation of the range-finding area by the mouse cursor 500on the range-finding frame in the first exemplary embodiment or adesignation of the face area by the mouse cursor 500 on the facedetection frame in the second exemplary embodiment.

The second exemplary embodiment uses two face detection frames. However,the number of the face detection frames can be determined by a facedetection function of the camera 200.

Furthermore, other pointing devices for operating the mouse pointer 500,such as a tablet, a trackball, and a trackpad, can be used other than amouse 105 a, and the keyboard 105 b can be also used, like the firstexemplary embodiment. Further, the button of the mouse 105 a can be aright side button and a left side button, or can be a scroll button.

Other Exemplary Embodiments

The control apparatus 100 according to the present invention is notlimited to the control apparatus 100 described in the first and secondexemplary embodiments. For example, the control apparatus 100 can be asystem including a plurality of apparatuses.

The various process and functions described in the first and secondexemplary embodiments can be realized by a computer program. Thecomputer program according to the present invention can be executed by acomputer (including a CPU), and the computer program can realize variousfunctions described in the first and second exemplary embodiments.

The computer program according to the present invention can realize thevarious process and functions described in the first and secondexemplary embodiments by using an operation system (OS) working on acomputer.

The computer reads the computer program according to the presentinvention from a computer-readable recording medium, and executes thecomputer program. The computer-readable recording medium may be a harddisk device, an optical disk, a compact disc read only memory (CD-ROM),a compact disc recordable (CD-R), a memory card, or a read only memory(ROM). The computer program according to the present invention can beprovided from an external apparatus via a communication interface, andexecuted by the computer.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all modifications, equivalent structures, and functions.

This application claims priority from Japanese Patent Application No.2009-103138 filed Apr. 21, 2009, which is hereby incorporated byreference herein in its entirety.

1. A control apparatus for controlling an image capture apparatus,comprising: a communication unit that receives a captured imagetransmitted from the image capture apparatus; and a control unit thatcontrols the control apparatus to display the captured image received bythe communication unit in an image display area, wherein the controlunit controls the control apparatus to display information indicating apredetermined area on the captured image displayed in the image displayarea, wherein the control unit determines whether or not thepredetermined area and a pointer operated by an operation unit areoverlapped, wherein the communication unit transmits a first command tothe image capture apparatus if the control unit determines that thepredetermined area and the pointer are overlapped, wherein the controlunit determines whether or not a button of the operation unit is clickedin a state that the predetermined area and the pointer are overlapped,wherein the communication unit transmits a second command to the imagecapture apparatus if the control unit determines that the button of theoperation unit is clicked in a state that the predetermined area and thepointer are overlapped, wherein the first command is a command forcausing the image capture apparatus to perform a shooting preparationprocess based on an image within the predetermined area, and wherein thesecond command is a command for causing the image capture apparatus toperform a shooting process for capturing a still image.
 2. The controlapparatus according to claim 1, wherein the communication unit transmitsa third command to the image capture apparatus, if the control unitdetermines that the predetermined area and the pointer are notoverlapped after the first command is transmitted to the image captureapparatus, and wherein the third command is a command for causing theimage capture apparatus to stop performing the shooting preparationprocess.
 3. The control apparatus according to claim 1, wherein thecommunication unit transmits a first notification to the image captureapparatus if the control unit determines that the predetermined area andthe pointer are overlapped, and wherein the first notification includesinformation for notifying the image capture apparatus that the pointeris overlapped on the predetermined area.
 4. The control apparatusaccording to claim 1, wherein the communication unit receives firstinformation indicating a position of the predetermined area from theimage capture apparatus, and wherein the control unit determines whetheror not the predetermined area and the pointer are overlapped, based onthe first information and second information indicating a position ofthe pointer.
 5. The control apparatus according to claim 1, wherein theoperation unit is one of a mouse, a trackpad, a trackball, and akeyboard.
 6. The control apparatus according to claim 1, wherein theshooting preparation process includes a focus process and an exposureprocess, wherein the focus process includes a process for determining afocusing position of the image capture apparatus based on an imagewithin the predetermined area, and wherein the exposure process includesa process for calculating an exposure value of the image captureapparatus based on the image within the predetermined area.
 7. Thecontrol apparatus according to claim 6, wherein the shooting processincludes a first process for capturing a still image based on thefocusing position and the exposure value, and a second process forrecording the still image captured by the image capture apparatus on arecording medium.
 8. The control apparatus according to claim 1, whereinthe predetermined area corresponds to a range-finding area.
 9. Thecontrol apparatus according to claim 1, wherein the predetermined areacorresponds to a face area.
 10. A method of controlling a controlapparatus that controls an image capture apparatus, the methodcomprising: receiving a captured image transmitted from the imagecapture apparatus; displaying the captured image transmitted from theimage capture apparatus in an image display area; displaying informationindicating a predetermined area on the captured image displayed in theimage display area; determining whether or not the predetermined areaand a pointer operated by an operation unit are overlapped; transmittinga first command to the image capture apparatus if it is determined thatthe predetermined area and the pointer are overlapped; determiningwhether or not a button of the operation unit is clicked in a state thatthe predetermined area and the pointer are overlapped; and transmittinga second command to the image capture apparatus if it is determined thatthe button of the operation unit is clicked in a state that thepredetermined area and the pointer are overlapped, wherein the firstcommand is a command for causing the image capture apparatus to performa shooting preparation process based on an image within thepredetermined area, and wherein the second command is a command forcausing the image capture apparatus to perform a shooting process forcapturing a still image.
 11. The method according to claim 10, furthercomprising: transmitting a third command to the image capture apparatus,if it is determined that the predetermined area and the pointer are notoverlapped after the first command is transmitted to the image captureapparatus, wherein the third command is a command for causing the imagecapture apparatus to stop performing the shooting preparation process.12. The method according to claim. 10, further comprising: transmittinga first notification to the image capture apparatus if it is determinesthat the predetermined area and the pointer are overlapped, wherein thefirst notification includes information for notifying the image captureapparatus that the pointer is overlapped on the predetermined area. 13.The method according to claim 10, further comprising: receiving firstinformation indicating the position of the predetermined area from theimage capture apparatus; and determining whether or not thepredetermined area and the pointer are overlapped, based on the firstinformation and second information indicating a position of the pointer.14. The method according to claim 10, wherein the operation unit is oneof a mouse, a trackpad, a trackball, and a keyboard.
 15. The methodaccording to claim 10, wherein the shooting preparation process includesa focus process and an exposure process, wherein the focus processincludes a process for determining a focusing position of the imagecapture apparatus based on an image within the predetermined area, andwherein the exposure process includes a process for calculating anexposure value of the image capture apparatus based on the image withinthe predetermined area.
 16. The method according to claim 15, whereinthe shooting process includes a first process for capturing a stillimage based on the focusing position and the exposure value, and asecond process for recording the still image captured by the imagecapture apparatus on a recording medium.
 17. The method according toclaim 10, wherein the predetermined area corresponds to a range-findingarea.
 18. The method according to claim 10, wherein the predeterminedarea corresponds to a face area.
 19. A computer-readable recordingmedium storing a program executed by a computer, the program causing thecomputer to perform a method of controlling a control apparatus thatcontrols an image capture apparatus, the method comprising: receiving acaptured image transmitted from the image capture apparatus; displayingthe captured image transmitted from the image capture apparatus in animage display area; displaying information indicating a predeterminedarea on the captured image displayed in the image display area;determining whether or not the predetermined area and a pointer operatedby an operation unit are overlapped; transmitting a first command to theimage capture apparatus if it is determined that the predetermined areaand the pointer are overlapped; determining whether or not a button ofthe operation unit is clicked in a state that the predetermined area andthe pointer are overlapped; and transmitting a second command to theimage capture apparatus if it is determined that the button of theoperation unit is clicked in a state that the predetermined area and thepointer are overlapped, wherein the first command is a command forcausing the image capture apparatus to perform a shooting preparationprocess based on an image within the predetermined area on which thepointer is overlapped, and wherein the second command is a command forcausing the image capture apparatus to perform a shooting process forcapturing a still image.
 20. The computer-readable recording mediumaccording to claim 19, further comprising: transmitting a third commandto the image capture apparatus, if it is determined that thepredetermined area and the pointer are not overlapped after the firstcommand is transmitted to the image capture apparatus, wherein the thirdcommand is a command for causing the image capture apparatus to stopperforming the shooting preparation process.
 21. The computer-readablerecording medium according to claim 19, further comprising: transmittinga first notification to the image capture apparatus if it is determinesthat the predetermined area and the pointer are overlapped, wherein thefirst notification includes information for notifying the image captureapparatus that the pointer is overlapped on the predetermined area. 22.The computer-readable recording medium according to claim 19, furthercomprising: receiving first information indicating the position of thepredetermined area from the image capture apparatus; and determiningwhether or not the predetermined area and the pointer are overlapped,based on the first information and second information indicating aposition of the pointer.
 23. The computer-readable recording mediumaccording to claim 19, wherein the operation unit is one of a mouse, atrackpad, a trackball, and a keyboard.
 24. The computer-readablerecording medium according to claim 19, wherein the shooting preparationprocess includes a focus process and an exposure process, wherein thefocus process includes a process for determining a focusing position ofthe image capture apparatus based on an image within the predeterminedarea, and wherein the exposure process includes a process forcalculating an exposure value of the image capture apparatus based onthe image within the predetermined area.
 25. The computer-readablerecording medium according to claim 24, wherein the shooting processincludes a first process for capturing a still image based on thefocusing position and the exposure value, and a second process forrecording the still image captured by the image capture apparatus on arecording medium.
 26. The computer-readable recording medium accordingto claim 19, wherein the predetermined area corresponds to arange-finding area.
 27. The computer-readable recording medium accordingto claim 19, wherein the predetermined area corresponds to a face area.